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1  Executive  Summary 


The  overall  program  provided  systematic  and  computationally  responsive  research  aimed  at  control  of  multi¬ 
agent  systems,  and  more  generally  systems  that  have  both  discrete  and  continuous  dynamics,  using  convex 
optimization  and  semidefinite  programming  as  the  foundation.  The  program  has  produced  research  results 
in  several  domains.  In  the  area  of  distributed  control  several  results  were  obtained:  new  stabilization  meth¬ 
ods  were  developed  for  systems  in  which  dynamical  agents  interact  over  bandlimited  channels;  synthesis 
methods  were  also  developed  for  metric-based  performance  optimization  of  distributed  systems  over  graphs. 
Systems  with  simultaneously  network  latency  and  finite  precision  sensing  were  targeted  and  algorithms  were 
developed  that  can  guarantee  stabilization  in  these  limited  information  scenarios.  For  switched  systems  a 
separate  program  accomplishment  was  the  development  of  equivalence  and  separation  principles  for  joint 
synthesis  of  switching  rules  and  policies.  Also,  the  first  known  exact  convex  conditions  for  receding  hori¬ 
zon  control  of  switched  systems  were  found,  together  with  design  algorithms  for  optimizing  metric-based 
performance.  New  decidability  and  verification  results  for  general  hybrid  setting  were  developed.  A  more 
technical  synopsis  is  provided  in  the  remainder  of  this  executive  summary;  the  sections  that  follow  this  sum¬ 
mary  are  devoted  to  more  detailed  reports  of  the  results.  Information  about  personnel  supported,  and  honors 
received  during  the  performance  period,  can  be  found  at  the  end  of  the  document. 

A  major  project  focus  area  was  switched  and  Markovian  jump  systems,  a  specific  subclass  of  hybrid  sys¬ 
tems  where  the  parameters  of  a  continuous-state  model  arc  switched  according  to  an  automaton  or  Markov 
chain.  One  direct  application  that  has  been  pursued  is  the  use  of  these  systems  in  modeling  latency  and 
packet-loss  in  communication  networks  supporting  control  objectives.  The  problem  of  jointly  synthesizing 
a  supervisor,  a  measurement  scheduler,  and  a  feedback  controller  for  guaranteed  stability  and  performance 
levels  for  discrete-time  switched  linear  systems  was  considered.  It  is  shown  that  open-loop  supervisory 
and  scheduling  laws  are  nonconservative  for  uniform  exponential  stability,  and  that  they  can  be  obtained 
separately  from  the  feedback  controller.  The  uniformity  requirement  in  exponential  stability  ensures  that 
both  mean-square  and  worst-case  type  performance  levels  arc  well-defined,  and  that  all  the  design  condi¬ 
tions  can  be  formulated  in  terms  of  semidefinite  programs.  Past  work  has  considered  situations  in  which 
the  automaton  is  open-loop,  and  only  the  control  of  the  continuous  states  can  be  controlled  via  feedback. 
A  recent  major  result  of  the  program  is  an  exact  convex  solution  to  the  receding  horizon  control  problem 
with  stochastic  performance  metrics  placed  on  the  performance  of  the  continuous  state.  This  is  a  problem 
with  a  very  long  history,  and  to  our  knowledge  our  solution  is  the  first  exact  (i.e.,  necessary  and  sufficient 
conditions)  convex  solution  to  this  problem.  From  an  operational  perspective  these  results  allow  for  optimal 
systematic  use  of  advanced  or  front-running  tactical  information  when  controlling  physical  agents.  Future 
work  involves  computational  algorithm  development  to  enable  capability  for  large-scale  application.  More 
technically,  considered  are  nominal  systems  with  state  space  models  that  switch  in  time,  whose  controllers 
have  access  to  the  precise  state  space  model  of  the  plant  for  a  horizon  into  the  future,  but  only  have  fore¬ 
knowledge  of  a  set  of  model  possibilities  beyond  this  horizon.  The  control  performance  criterion  is  a  bound 
on  the  variance  over  this  moving  window,  and  a  particular  feature  of  the  research  that  this  metric  can  change 
depending  on  the  system  discrete  state;  namely,  this  work  provides  designers  with  the  direct  capability  to 
choose  performance  objectives  that  change  as  tactical  situations  evolve.  In  fact,  considered  is  a  more  general 
scenario  where  evolution  of  the  discrete  dynamics  may  be  governed  by  an  automaton.  Exact  convex  condi¬ 
tions  arc  provided  for  the  existence  of  a  output  feedback  policies  that  can  uniformly  exponentially  stabilize 
such  systems  and  achieve  the  desired  stochastic  performance  specification.  Each  condition  is  in  terms  of  a 
nested  sequence  of  semidefinite  programs,  where  (a)  feasibility  to  any  element  provides  an  explicit  control 
policy;  and  (b)  infeasibility  implies  that  a  controller  does  not  exist  for  a  given  performance-stability  level. 
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Another  area  of  accomplishment  has  been  on  distributed  synthesis.  One  of  the  research  thrusts  has  been 
investigation  of  spatially  distributed  heterogeneous  systems  over  infinite  lattices.  An  operator-pencil  ap¬ 
proach  has  been  employed  to  develop  new  analysis  and  synthesis  conditions  that  arc  less  conservative  than 
existing  work,  using  operator  inequalities  and  convex  programming.  Also  considered  has  been  the  related 
question  of  decentralized  control  in  the  setting  of  finite  wordlength  sensing  or  communication  channels. 
Specifically,  considered  was  decentralized  stabilization  of  a  global  system  by  means  of  multiple  agents  that 
receive  sensing  information  through  rate-limited  channels,  while  these  stations  are  not  capable  of  commu¬ 
nicating  with  each  other  directly.  The  main  result  is  a  condition  on  the  data  rate  of  respective  channels  that 
guarantees  system  stabilizability.  Provided  is  an  explicit  way  to  construct  the  associated  stabilizing  encoder, 
decoder,  and  controller.  Robustness  of  the  resulting  control  strategy  is  also  established;  specifically,  analysis 
showing  that  the  new  control  algorithm  is  structurally  robust  against  model  mismatch  is  provided. 

A  major  area  of  progress  is  modeling  for  general  hybrid  automata,  and  in  particular'  classifying  mod¬ 
els  with  decidable  verification  properties.  This  work  is  directly  aimed  at  developing  tools  for  verification 
and  validation.  In  the  project  is  has  been  shown  that  for  o-minimally  definable  hybrid  automata  with  a 
bounded  discrete-transition  horizon,  a  finite  bisimulation  exists  and  can  be  constructed  given  certain  de¬ 
cidability  assumptions  on  the  underlying  o-minimal  theory.  More  importantly,  we  give  specifications  for 
hybrid  automata  which  ensure  this  boundedness.  In  addition,  we  show  that  these  specifications  are  reason¬ 
ably  tight  and  that  they  can  model  realtime  and  cyberphysical  systems.  Another  recent  line  of  research  that 
ties  together  many  of  the  methods  used  in  the  project  is  investigation  into  the  use  of  pre-orders  for  analyzing 
hybrid  system  properties;  pre-orders  between  processes,  like  simulation,  have  played  a  central  role  in  the 
verification  and  analysis  of  purely  discrete-state  systems,  where  verifying  correctness  is  achieved  through 
system  abstraction. 

The  publications  associated  with  the  project  research  are  listed  in  Section  10  of  this  document.  The 
remainder  of  this  report  provides  a  more  detailed  account  of  the  project  research. 

2  Stabilization  in  Markovian  Jump  and  Switched  Systems 

Part  of  the  program  addressed  the  problem  of  jointly  synthesizing  a  switching  rule  and  a  feedback  controller 
for  automata-switched  systems  to  guarantee  stability  and  performance  levels  subject  to  well-posedness-like 
constraints.  Two  main  results  obtained  are  the  equivalence  of  open-loop  and  closed-loop  switching,  and  the 
separation  between  switching  and  feedback.  That  is,  open-loop  switching  rules  are  non-conservative  for 
stabilization  and  performance  optimization,  and  in  output  feedback  control  they  can  be  obtained  separately 
from  the  feedback  controller.  The  synthesis  conditions  for  switching  and  feedback  are  convex  and  expressed 
in  terms  of  linear  matrix  inequalities.  Below  this  work  is  overviewed  based  on  the  research  reported  in 
[6,8,11]. 

The  problem  of  determining  optimal  stabilizing  switching  rules  arises  in  the  context  of  supervisory 
control  and  measurement  scheduling.  In  the  problem  of  supervisory  control,  one  is  given  a  set  of  controllers 
for  a  single  plant.  At  each  time  instant,  the  supervisor  chooses  a  controller  among  this  set  based  on  the 
past  and  present  state  measurements,  and  uses  the  chosen  controller  to  close  the  feedback  loop.  Due  to  the 
switching  among  different  controllers,  the  overall  closed-loop  system  is  time-varying  but  can  potentially 
exhibit  better  stability  and  performance  properties  than  when  the  feedback  loop  is  closed  using  any  single 
controller  among  the  given  set.  On  the  other  hand,  in  the  problem  of  measurement  scheduling,  one  is  given 
a  set  of  sensors  for  a  single  plant.  At  each  time  instant,  the  scheduler  chooses  a  sensor  among  this  set 
based  on  the  past  state  measurements  it  has  made,  and  samples  a  new  state  measurement  using  the  chosen 
sensor.  Again,  due  to  the  switching  among  multiple  sensors,  the  overall  system  is  time- varying  and  yet,  once 
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feedback-interconnected  with  a  suitable  controller,  it  can  potentially  yield  better  stability  and  performance 
properties  than  when  feedback-controlled  using  any  single  sensor  among  the  given  set. 

In  this  research  automata-switched  systems  are  considered  with  the  objective  of  performing  joint  syn¬ 
thesis  of  a  switching  rule  and  a  feedback  controller  for  uniform  exponential  stability  and  guaranteed  'Hv  and 
T-Loo  type  performance  levels.  A  switched  linear  system  under  a  general  switching  rule  exhibits  nonlinear 
behavior.  To  ensure  such  a  nonlinear  system  possesses  the  kind  of  robustness  that  uniformly  exponentially 
stable  standard  linear  systems  exhibit  against  state  perturbations,  a  separation  is  imposed  on  the  total  re¬ 
sponse  of  the  system  into  a  zero-input  response-like  term  and  a  zero-state  response-like  term.  Imposing 
this  requirement  guarantees  that  one  can  speak  of  “stability  under  zero  input”  and  “performance  under  zero 
initial  state”  at  the  same  time  as  in  the  standard  'H->  and  control  problems.  Similarly,  to  ensure  the  over¬ 
all  nonlinear  system  possesses  the  kind  of  small  gain  property  and  its  converse  that  standard  linear  systems 
exhibit  against  dynamic  uncertainty,  a  separation  is  imposed  on  the  response  of  the  uncertain  system  into  the 
dynamics  associated  with  the  plant  and  that  with  the  uncertainty  block.  This  requirement  is  analogous  to  the 
stability  requirement:  While  the  stability  definition  requires  robustness  against  “static”  state  perturbations, 
the  performance  definition  requires  robustness  against  “dynamic”  feedback  uncertainties. 

Under  these  stability  and  performance  requirements  the  following  fundamental  results/principles  arc 
derived: 

•  Equivalence:  Whenever  a  closed-loop  switching  rule  is  stabilizing  and  guarantees  a  performance 
level,  there  exists  an  open-loop  switching  rule  that  does  so  and  results  in  a  periodic  switching  se¬ 
quence. 

•  Separation:  The  joint  synthesis  problem  for  a  switching  rule  and  a  feedback  controller  is  separated, 
and  one  can  obtain  a  switching  rule  separately  from  the  feedback  controller. 

The  results  obtained  arc  in  contrast  to  the  fact  that  there  arc  cases  where  open-loop  switching  rules  are  not 
sufficient  when  mere  asymptotic  stability  is  required;  namely,  the  additional  condition  of  structural  well- 
posedness  is  not  previously  assumed. 

Aside  from  this  structural  well-posedness  requirement  on  asymptotic  stability,  it  is  also  required  that  the 
feedback  controller  should  be  able  to  recall  past  switching  paths  as  well  as  past  state  measurements.  That 
is,  it  is  required  that  the  feedback  controller  be  not  only  dynamic  (with  the  information  about  past  measure¬ 
ments  stored  in  its  state)  but  also  switching  path-dependent  (with  the  information  about  past  switching  paths 
encoded  in  its  coefficients).  With  this  it  can  be  shown  that  the  order  of  the  controller  can  be  no  more  than 
that  of  the  plant,  and  the  length  of  the  past  switching  paths  encoded  in  the  controller  coefficients  can  be  no 
more  than  the  period  of  the  open-loop  switching  sequence.  Such  a  requirement  is  crucial  in  guaranteeing 
nonconservative  synthesis  of  switching  rules  and  feedback  controllers.  In  particular,  the  derived  conditions 
for  joint  synthesis  of  switching  and  feedback  arc  expressed  in  terms  of  linear  matrix  inequalities.  More¬ 
over,  these  conditions  give  rise  to  switching  path-dependent  Lyapunov  functions  and  cover  the  common 
Lyapunov  function  and  multiple  Lyapunov  functions  approaches  as  special  cases  of  path  length  zero  and 
one,  respectively.  An  optimal  switching  sequence  can,  in  principle,  be  determined  by  solving  an  increasing 
sequence  of  semidefinite  programs  indexed  by  the  length  of  past  switching  paths  that  the  feedback  controller 
should  recall. 

The  results  described  arc  divided  below  into  two  parts,  one  considering  only  uniform  exponential  stabil¬ 
ity,  and  the  other  considering  the  more  difficult  question  of  performance. 

For  x  €  Mn  and  A  €  Mmxn,  denoted  by  ||x||  and  ||  A||  arc  the  Euclidean  norm  of  x  and  the  spectral  norm 
of  A,  respectively.  If  X,  Y  €  Mnxn  are  symmetric  (i.e.,  X  =  X1  and  Y  =  YT),  then  we  write  X  <  Y  or 
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Y  —  X  >  0  to  mean  that  Y  —  X  (resp.  X  —  Y)  is  positive  definite  (resp.  negative  definite).  The  identity 
matrices,  with  their  dimensions  understood,  arc  denoted  I;  similarly,  the  zero  matrices  are  denoted  0. 

2.1  Switching  and  feedback  for  uniform  exponential  stability 

Let 

S  =  {(Ai,Ci):i  =  l,...,N} 

be  an  indexed  set  of  N  matrix  pairs,  where  A,  G  Mnxn  and  C,  G  M,x? 

N.  The  set  S  defines  a  switched-automata  system  given  by 

x(t+  1)  =  A0(t)x(i),  t  €  N0; 
y(t)  =  C 9(t)x(t),  t  G  N0, 

over  all  switching  sequences 

0  =  (0(O),0(1),...)g{1 

We  do  not  distinguish  between  the  set  S  and  the  difference  equation  it  defines,  they  arc  both  referred  to  as 
switched-automata  systems.  If  9{t)  =  i  for  some  t  G  No  and  i  G  {1,  ...,  N},  then  the  switched-automata 
system  is  said  to  be  in  mode  i  at  time  t.  Once  a  switching  sequence  9  G  {1,  . . . ,  N}°°  and  an  initial  state 
x(0)  G  Mn  are  specified,  the  state-space  model  (2)  generates  a  state  sequence  x  =  (x(0),  :c(l),  . . . )  and  a 
measurement  sequence  y  =  (y( 0),  y(  1),  . . . ). 

Presented  below  is  an  exact  condition  for  the  existence  of  a  stabilizing  switching  rule  for  S.  This  con¬ 
dition  will  turn  out  to  be  equivalent  to  an  exact  condition  for  the  existence  of  a  single  stabilizing  switching 
sequence  9,  which  works  independently  of  the  state  measurements.  Furthermore,  we  will  extend  the  condi¬ 
tion  to  joint  synthesis  of  switching  and  feedback  for  stabilizing  S. 

2.1.1  Definitions 

Let  S  be  as  in  (1).  Let 


(1) 

are  given  matrices  for  all*  =  1,  ... , 

(2a) 

(2b) 


9  =  {at  ■  t 

£  N0} 

(3a) 

be  an  indexed  family  of  functions  such  that 

0(t)  =  9t{y 4)  €  {!,- 

•  •  >  t  G  Nq, 

(3b) 

where  yt  =  (y( 0), . . .  ,y(t)).  Then  the  family  g  defines  a  switching  rule  that  generates  a  switching  se¬ 
quence  9  for  the  switched  linear  system  S  based  on  the  measurement  sequence  y.  As  in  the  measurement 
scheduling  case,  one  may  also  consider  switching  rules  that  generate  9(t.)  based  on  past  measurements  ?/“  1 
only.  The  results  described  in  this  section  and  subsequent  sections  carry  over  to  such  switching  rules  as  well. 

A  switching  rule  g  is  said  to  be  asymptotically  stabilizing  for  S  if  the  state  equation  (2a)  satisfies  xit  )  —> 
0  as  t  — >•  oo  under  g.  Similarly,  a  switching  sequence  9  is  said  to  be  asymptotically  stabilizing  for  S  if 
x(t)  —>  0  as  t  -G  oo  over  all  initial  states  x(0).  The  stability  notions  of  this  research  arc  stronger  than  just 
described  and  require  that  the  state  x(t)  — >  0  with  a  uniform  exponential  decay  rate  over  all  initial  state  and 
over  all  state  perturbations,  in  the  same  vein  as  the  MILS  systems  described  in  an  earlier  research  section 
above.  Consider  what  we  call  the  internal  automata-switched  linear  system: 

x(t  +  1)  =  Ae^x(t)  +r(t),  t  G  N0.  (4) 
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Definition  1.  A  switching  rule  g  as  in  (3)  is  said  to  be  uniformly  exponentially  stabilizing  for  the  automata- 
switched  system  S  if  there  exist  c  >  0  and  A  €  (0, 1)  such  that  the  internal  switched  linear  system  (4),  with 
6(f)  =  gfiy1)  for  all  t  G  No,  satisfies 

||x(f)||  <  cAi||x(0)||  (5a) 

for  all  t  G  No  and  x(0 )  G  R"  whenever  r( 0)  =  r(l)  =  •  •  •  =  0,  and 


x 


for  all  to,  t  6  No  with  t  >  to  and  r(to)  G 

•  •  •  =  0. 


<cAt-tlr(t0)||  (5b) 

whenever  x(0)  =  r(0)  =  •  •  •  =  r(to  —  1)  =  r(to  +  1)  = 


Definition  2.  A  switching  sequence  6  G  {1,  . . . ,  N}°°  is  said  to  be  uniformly  exponentially  stabilizing  for 
the  switched-automata  system  S  if  there  exist  c  >  0  and  A  G  (0, 1)  such  that 


|<MMo)||  <0^-*° 


for  all  to,  t  G  Nq  with  t  >  t-o,  where 


<MMo)=  >-1} 


v0(to)i 


t  >  t0 ; 
t  =  to¬ 


ll  is  readily  seen  that  the  existence  of  a  uniformly  exponentially  stabilizing  switching  sequence  implies 
that  of  a  uniformly  exponentially  stabilizing  switching  rule.  The  converse  also  holds  true.  For  each  M  G  No, 
the  elements  of  { 1, ... ,  N}M+1  will  be  called  switching  paths  of  length  M .  A  nonempty  set  A f  of  switching 
paths  of  length  M  is  said  to  be  admissible  if,  for  each  (iq, . . . ,  im)  €  A/",  there  exist  a  K  G  N,  with  K  >  M, 
and  a  switching  path  (iM+ 1,  •  •  • ,  ii<)  such  that  ( Ir-m ,  •  •  • ,  ik)  =  <Ao,  •  •  • ,  *m)  and  (it, . . . ,  h+m)  &  N  for 
all  t  G  {0,  . . . ,  K  —  M}.  An  admissible  set  A f  of  switching  paths  is  called  minimal  if  none  of  the  proper 
subsets  of  A f  is  admissible.  It  is  readily  seen  that,  if  AT  is  a  minimal  set  of  switching  paths  of  length  M,  then 
there  exists  a  switching  sequence  6  such  that 


A f  =  {(i0,  •••,*¥):  O'o,  •  •  -,hi)  =  (6(t),  ...,9(t  +  M)),  t  G  N0}. 
It  can  be  shown  that  a  switching  sequence  is  periodic  and  is  unique  up  to  a  time  shift. 


(6) 


2.1.2  Synthesis  of  switching  rules 

The  following  theorem  characterizes  the  existence  of  uniformly  exponentially  stabilizing  switching  laws. 
Theorem  1.  Let  S  be  as  in  (1).  The  following  are  equivalent: 

(a)  There  is  a  uniformly  exponentially  stabilizing  switching  rule  for  S. 

(b)  There  is  a  uniformly  exponentially  stabilizing  switching  sequence  for  S. 

(c)  There  exist  a  path  length  M  G  No,  a  minimal  set  J\f  of  switching  paths  of  length  M,  and  matrices 

£  MnXn  such  That 

for  all  (i0, . . .  ,iM)  €  AT. 
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Moreover,  if  condition  (c)  holds,  then  any  periodic  switching  sequence  9  satisfying  (6)  is  uniformly  expo¬ 
nentially  stabilizing  for  S. 


Generation  of  all  minimal  sets  of  switching  paths  of  length  M  amounts  to  identifying  all  elementary 
cycles  in  a  directed  graph  whose  nodes  are  switching  paths  of  length  M  —  1.  There  are  well-known  algo¬ 
rithms  for  finding  all  elementary  cycles  in  a  directed  graph  is  presented.  There  are  counter  examples  which 
show  that  the  existence  of  a  switching  rule  that  guarantees  asymptotic  stability  does  not  necessarily  imply 
the  existence  of  an  asymptotically  stabilizing  switching  sequence.  However,  Theorem  1  says  that  adding  a 
uniformity/robustness  requirement  to  the  stability  notion  makes  the  situation  quite  different. 


Example  1.  Suppose  N 


2  and S  has 


■1 

0" 

~V3 

1 

Ai  = 

2 

0 

2 

5  A2  = 

2 

1 

2 

2 

V3 

2 

Ci  =  C2 


1  0 
0  1 


It  has  been  shown  previously  that  there  exist  asymptotically  stabilizing  switching  rules  for  this  S;  one  such 
rule  g  =  {gt}  is  given  by 

0{t)  =  gt (x*) 

{1  ifx(t )  =  [x\  X2]t  with  \x\\  >  2|x2|; 

2  otherwise. 


However,  it  is  easy  to  see  that  there  is  no  asymptotically  stabilizing  switching  sequence  for  this  case  since 
the  determinants  of  both  matrices,  and  hence  any  product  of  them,  is  one.  Therefore,  Theorem  1  suggests 
that  no  switching  rule  is  uniformly  exponentially  stabilizing  for  S.  Indeed,  if 


x(0)  = 


r(0) 


0 

1  -  v/3  ’ 


and 


r(t )  = 


fort  >  1, 


then  the  internal  system  (4)  under  g  generates  the  switching  sequence  9  =  (2, 1, 1, . . . );  letting  xo(t) 
(resp.  xr(t))  be  the  response  of  the  internal  system  to  x(0)  (resp.  r(0)),  we  have  that  both  xq  (t)  and  xr(t) 
diverge  even  though  x(t)  =  xq (t)  +  xr(t)  — >•  0. 


Example  2.  Let  us  replace  A\  in  Example  1  with 


0 

1 


Then  the  spectral  radius  of  A2A1  is  less  than  one,  and  hence  the  periodic  switching  sequence 


9  =  (1,2, 1,2,...), 


where  modes  1  and  2  alternate,  is  uniformly  exponentially  stabilizing.  This  switching  sequence  is  generated 
by  the  following  open-loop  switching  rule: 


9(t)  =  gt(x *) 


1 

2 


if  t  is  even; 
ift  is  odd. 


2.1.3  Joint  synthesis  of  switching  and  feedback 

Let  Ai,  A jv  £  Mnxn,  Bi,  Bjv  €  Wnxm,  and  Ci,  C^r  £  Mixn  be  given.  Consider  the 

controlled  plant  model  of  the  form 

x(t  +  1)  =  A0(t)x(f)  +  Be^u(t),  f  e  N0;  (8a) 

y(*)  =  C0p)x(f),  f  €  N0.  (8b) 

Assuming  that  the  mode  0(f)  is  perfectly  observed  by  the  feedback  controller  at  each  time  instant  f  €  No,  and 
that  the  controller  is  able  to  recall  L  most  recent  past  modes,  consider  dynamic  output  feedback  controllers 
of  the  form 


XR :(t  +  1)  =  A K,(0(t-L),...,0(t))xK{t)  +  B K,(0(t-L),...,6(t))y(i),  t  £  N0; 

u(t)  =  c Kt(0(t_L),...,6(t))XK{t)  +  D K,{O(t-L),...,0(t))y(t)  1  t  C  No- 

Closing  the  feedback  loop  via  such  a  controller  yields 


where  x(t) 


x(t  +  1) 


0  B  e(t) 

I  0 


i 

o 


x(t ), 


[x(f)T  XK(t)]T  and 


(9) 


(10) 


for  t  £  No- 

The  following  result  is  immediate  from  Theorem  1  and  our  previous  work,  and  enables  us  to  determine 
a  switching  rule  and  a  feedback  controller  such  that  the  closed-loop  system  (9)  is  uniformly  exponentially 
stable. 


Corollary  1.  Let  the  controlled  plant  be  given  by  (8).  The  following  are  equivalent: 

(a)  There  exist  a  switching  rule  g  and  a  set  of  controller  coefficients  (10),  where  0(f)  =  gtflf),  such  that 
the  closed-loop  system  (9)  is  uniformly  exponentially  stable. 


(b)  There  exist  a  switching  sequence  6  and  a  set  of  controller  coefficients  (10)  such  that  the  closed-loop 
system  (9)  is  uniformly  exponentially  stable. 


(c)  There  exist  a  path  length  M  £  No,  a  minimal  set  AT  of  switching  paths  of  length  M,  and  matrices 
ROo,...,iM-i)>  e  M"Xn  such  That 


^(B  iM) 

-  R(w,...,iM))iV(BiM)  X  °> 


N(CjM)T(Al,S 


So0,...,tM-1))^(CiM)  0, 


R 


>-  0. 


(11a) 

(lib) 

(He) 


for  all  (*o, . . .  ,im)  £  AC,  where  A(M)  denotes  any  full-column-rank  matrix  whose  columns  span  the 
null  space  of  M. 
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Moreover,  if  condition  ( c )  holds,  then  the  closed-loop  system  (9)  is  uniformly  exponentially  stable  under  a 
periodic  switching  sequence  6  satisfying  (6)  and  a  set  of  feedback  controller  coefficients  (10)  with  L  =  M. 

Once  the  semidefinite  inequalities  (11)  have  been  solved  for  some  path  length  M  and  minimal  set  A f,  a 
stabilizing  set  of  controller  coefficients  (10)  can  be  obtained  based  on  the  well-known  linear  matrix  inequal¬ 
ity  embedding  technique. 


2.2  Switching  and  feedback  for  guaranteed  performance 

Results  on  performance,  not  just  stability,  arc  outlined  in  this  section. 

Let 

T  =  {(Aj,  Bj,  CM,  Di;j,  C2 ,i,  D2)i) :  i  =  1, . . . ,  N}  (12) 

be  an  indexed  set  of  matrix  tuples,  where  Aj  €  Mnxn,  B,  €  Rnxm,  Ci ti  G  Rhxn,  D M  G  RllXm, 
C2 ,i  G  M*2Xn,  and  D 2  j  G  Rl2Xm,  i  =  1,  . . N,  are  given  matrices.  The  set  T  defines  the  family  of  linear 
time- varying  state-space  equations 


x(t  +  1)  =  A0^x(t)  +  B0^w(t),  te  N0;  (13a) 

z(t)  =  Ci tg(t)x(t)  +  Di f(t)w{t),  t.  G  N0;  (13b) 

y(t)  =  C 2,0(t)x(t)  +  D 2,0(t)w{t),  t.  €  N0,  (13c) 

over  all  switching  sequences  0  6  {1,...,^}°°.  Given  a  switching  sequence  6,  a  disturbance  input  sequence 
w  =  (w(0),  w(l),  . . . ),  and  an  initial  state  x(0)  G  Mn,  the  linear  time-varying  system  (13)  generates  an 
output  sequence  z  =  (z(0),  z(  1),  . . . )  in  addition  to  the  state  sequence  x  and  measurement  sequence  y. 

The  "H2-type  performance  measure  considered  in  this  research  gives  the  square  root  of  the  average  output 
variance  per  unit  time  of  the  state-space  model  (13)  under  white  Gaussian  disturbance  input  sequence  w,  and 
it  indicates  how  well  the  system  output  is  regulated  under  random  disturbances.  On  the  other  hand,  the 
type  performance  measure  considered  in  the  research  requires  that  the  switching  rule  g  satisfy  the  following 
small  gain  property:  Whenever  a  disturbance  sequence  w  generates  a  switching  sequence  6  for  (12),  the 
state-space  model  (13)  is  robustly  well-connected  with  all  sufficiently  small  dynamic  uncertainties. 

Definition  3.  A  switching  rule  g  as  in  (3)  is  said  to  achieve  output  regulation  level  7  >  0  for  the  automata- 
switched  system  T  if  it  is  uniformly  exponentially  stabilizing  for  T  whenever  w  =  0  and  if  there  exists  a 
7  G  (0, 7)  such  that,  whenever  x(0)  =  0,  the  state-space  equations  (13)  satisfy 


1 


lim  m 

T— >00  T  +  1 


T 


]TE|Kt)||2<72, 

t= 0 


where  w  is  unit  variance  white  noise. 


Definition  4.  A  switching  sequence  0  G  {1 , ,N}°°  is  said  to  achieve  output  regulation  level  7  >  0  for 
the  automata-switched  system  T  if  it  is  uniformly  exponentially  stabilizing  for  T  whenever  w  =  0  and  if 


lim  „ 
t—r  00  T  + 


t= 0 


m)  ^ 
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where 


Y  e{to,t) 


t- 1 


Y1  ^e{t,  s  +  l)Bg(s)Be^$g(t,  s  +  1)  , 

S=to 

t  >  t0; 

0,  t  =  to- 


(14) 


Definition  5.  A  switching  rule  g  as  in  (3)  is  said  to  achieve  disturbance  attenuation  level  7  >  0  for  the 
automata- switched  system  T  if  it  is  uniformly  exponentially  stabilizing  for  'T  whenever  w  =  0  and  if  there 
exists  a  7  G  (0, 7)  such  that,  whenever  x(0)  =  0,  the  state-space  model  (13)  feedback-interconnected  with 
w  =  r  +  A z  has  z  =  0  as  the  unique  response  to  w  =  0  over  all  linear  operators  A  satisfying 


£lMt)ll2<r2£Nt)ll2 

t= 0  t= 0 


(15) 


for  all  z  with  Ylu=o  ||z(f)||2  <  00. 

Definition  6.  A  switching  sequence  6  e  {1, . . . ,  N}°°  is  said  to  achieve  disturbance  attenuation  level  7  >  0 
for  the  switched  linear  system  T  if  it  is  uniformly  exponentially  stabilizing  for  T  whenever  w  =  0  and  if 
there  exists  a  7  €  (0, 7)  such  that 

||m0(Mo)||  <  7 

for  all  to,  t  €  Nq  with  t-o  <  t,  where 


t0) 


Dl,0(to) 

Cl,0(to+l)B6i(to) 


0 

Di,0(to+i) 


^0  +  l)Be(t0)  to  +  2)Bg(to+1) 

If  6  is  a  switching  sequence,  and  if  x(0)  =  0,  then  z(0)  =  D1^0)w(0)  and 


0 

0 


t-i 

z(t)  =  Yi  C  1  ,o(t)*e(t,  s  +  1)B e(s)w(s)  + 

s= 0 

for  all  t  €  N.  Thus  it  is  readily  seen  that,  if  a  switching  sequence  6  achieves  an  output  regulation  level,  or  a 
disturbance  attenuation  level,  then  there  exists  a  switching  rule  g  that  achieves  the  same  performance  level. 

In  the  research  it  was  shown  that  the  converse  also  holds,  and  exact  convex  synthesis  conditions  for  such 
a  switching  rule  is  given  below.  An  extension  to  joint  synthesis  of  switching  and  feedback  has  also  been 
obtained  and  will  be  presented  below. 

2.2.1  Synthesis  of  switching  rules 

The  following  theorems  characterize  the  existence  of  switching  rules  that  achieve  guaranteed  performance 
levels.  They  also  give  convex  synthesis  conditions  for  obtaining  these  rules. 

Theorem  2.  Let  T  be  as  in  (12);  let  7  >  0.  The  following  are  equivalent: 

(a)  There  exists  a  switching  rule  that  achieves  output  regulation  level  y  for  T. 
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( b)  There  exists  a  switching  sequence  that  achieves  output  regulation  level  7  for  T. 

(c)  There  exist  a  path  length  M  €  No,  a  minimal  set  A f  of  switching  paths  of  length  M,  and  matrices 

€  RnXn  such  That 


a*my, 

for  all  (io, ...  ,im)  £  Af,  and  such  that 

1 

W\ 


(16a) 

(16b) 


(16c) 


where  Ar|  denotes  the  cardinality  ofAf. 

Moreover,  if  condition  (c)  holds,  then  any  periodic  switching  sequence  6  satisfying  (6)  achieves  output 
regulation  level  7  for  T. 

Theorem  3.  Let  T  be  as  in  (12);  let  7  >  0.  The  following  are  equivalent: 

(a)  There  exists  a  switching  rule  that  achieves  disturbance  attenuation  level  7  for  T. 

(b)  There  exists  a  switching  sequence  that  achieves  disturbance  attenuation  level  y  for  T. 

(c)  There  exist  a  path  length  M  €  No,  a  minimal  set  AT  of  switching  paths  of  length  M,  and  matrices 

£  RnXn  such  That 


(*0, ->«M— l) 


>-  0 


and 


r  a  •  r-  1 

Y(io,-,iM- 1)  0 

x 

r  a  •  r-  1 

T 

Y(h,...,iM) 

_^1  ,iM 

0  !_ 

/-'Mm  V 

0  72i_ 

(17a) 


7  0  (17b) 


for  all  (i0,  ■  ■  ■  ,«m)  G  AT. 

Moreover,  if  condition  (c)  holds,  then  any  periodic  switching  sequence  6  satisfying  (6)  achieves  disturbance 
attenuation  level  7  for  T. 


Example  3.  Suppose  N  =  2  and  T  has 


■1 

O" 

r  73 

1 

Ai  = 

2 

0 

1 

>  A2  = 

2 

1 

2 

2 

V3 

2  _ 

Bi  =  Bo  = 


C71  —  Ci, 2  — 


Di,i  =  Di,2  = 


1  0 
0  1 

o' 


J  C2.I  —  C2,2  — 


D27  —  D2,2 


1  0 
0  1 

Y 

0 


For  illustration  the  condition  (c)  of  Theorem  3  is  now  used  to  obtain  best  switching  sequences  in  terms  of 
their  disturbance  attenuation  performance.  There  are  two  minimal  sets  of  switching  paths  of  length  zero; 
namely,  {1}  and  {2}.  Since  the  spectral  radii  of  A\  and  A2  are  not  less  than  1,  inequalities  (17)  are 
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infeasible  for  any  7  >  0  if  M  =  0.  However,  among  three  minimal  sets  of  switching  paths  of  length  one 
( namely,  {(1, 1)},  {(1,  2),  (2, 1)},  and  {(2,  2)}), 

AT  =  {(1,2),  (2,1)} 

renders  (17)  feasible  if  and  only  if  M  =  1  and  7  >  6.845  (up  to  four  significant  digits).  Thus  the  periodic 
switching  sequence 

0  =  (1,2, 1,2,...) 

achieves  all  disturbance  attenuation  levels  7  >  6.845  but  does  not  achieve  any  disturbance  attenuation  level 
7  <  6.844.  Incrementing  the  path  length  to  M  =  2,  we  obtain  six  minimal  sets  of  switching  paths  of  length 
two.  Among  them, 

N  =  {(1,1,  2),  (1,2,  2),  (2,  2,1),  (2, 1,1)} 

renders  (17)  feasible  if  and  only  if  M  =  2  and  7  >  6.484.  Thus  the  periodic  switching  sequence 

6  =  (1,1,  2,  2, 1,1,  2,  2,...) 

achieves  all  disturbance  attenuation  levels  7  >  6.484  but  does  not  achieve  any  disturbance  attenuation  level 
7  <  6.483.  One  can  find  a  better  switching  sequence  by  increasing  the  path  length  further  For  path  length 
M  =  3,  the  minimal  set 

AT  =  {(1,1, 1,2),  (1,1,  2, 2),  (1,2,  2,  2),  (2,  2,  2,1),  (2,  2, 1,1),  (2, 1,1,1)} 

is  the  best  one,  and  one  concludes  that  the  periodic  switching  sequence 

9  =  (1,1, 1,2,  2,  2, 1,1, 1,2,2,  2,...), 

where  the  switching  sequence  (1, 1, 1,  2,  2,  2)  repeats,  achieves  all  disturbance  attenuation  levels  7  >  6.466 
and  does  not  achieve  any  disturbance  attenuation  level  7  <  6.465.  For  this  particular  example,  increment¬ 
ing  the  path  length  even  further  to  M  =  4  does  not  improve  the  performance  level. 

2.2.2  Joint  synthesis  of  switching  and  feedback 

Joint  synthesis  of  a  switching  rule  and  a  feedback  controller  is  also  possible  for  achieving  guaranteed  distur¬ 
bance  attenuation  performance  in  view  of  Theorem  2  and  prior  work,  and  for  achieving  guaranteed  output 
regulation  performance  in  view  of  Theorem  3.  The  technical  development  is  similar  to  that  of  §  2.1.3. 

3  Multi-resolution  Sensing,  Control  and  Switched  Systems 

The  program  work  described  in  this  section  was  motivated  by  the  need  for  analytical  tools  for  assessing 
stability  of  control  systems  acting  over  networks.  In  particular  the  goal  was  to  develop  tools  that  could  si¬ 
multaneously  handle  latency  over  the  network  and  finite  information  in  the  feedback  measurement;  the  latter 
condition  represented  either  finite -precision  in  measurement,  or  finite -bandwidth  limitations  of  transmission 
channels.  Explicit  tools  and  testing  conditions  were  developed  for  this  in  a  switched-automata  system  frame¬ 
work,  and  the  results  of  this  effort  are  reported  in  [3,10]  and  the  submitted  paper  [15].  More  details  about  the 
specifics  of  this  research  now  follow.  This  research  agenda  was  pursued  by  addressing  almost  sure  uniform 
exponential  stabilization  and  second-order  stabilization  of  Markovian  jump  linear  systems  (MJLSs)  with 
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logarithmically  quantized  state  feedbacks.  Markovian  jump  linear  systems  can  be  regarded  as  a  special  case 
of  switched  systems.  Introduced  were  the  concepts  and  explicit  constructions  of  stabilizing  mode -dependent 
and  finite  path-dependent  logarithmic  quantizers  together  with  associated  controllers.  Also  developed  was  a 
semiconvex  way  to  determine  the  optimal  (coarsest)  stabilizing  quantization  density. 

The  work  investigates  quantized  control  problem  of  Markovian  jump  systems  (MJSs),  where  stabiliza¬ 
tion  is  considered,  either  using  a  mean-square  criterion,  or  an  almost  sure  uniform  stability  criterion.  For 
MJSs,  second-order  stability  implies  almost  sure  non-uniform  stability;  however,  almost  sure  uniform  ex¬ 
ponential  stability  (UES)  requires  sample  paths  to  quadratically  decrease  almost  surely  uniformly.  This 
guarantees  the  worst  case  scenario  performance  and  is  therefore  a  much  stronger  requirement  than  the  sta¬ 
tistical  sense  second-order  stability.  In  the  project  research,  we  consider  the  situation  where  measurements 
arc  logarithmically  quantized  before  sending  to  controllers,  as  an  effort  to  model  the  finite  wordlength  con¬ 
straint  of  a  communication  channel,  or  multi-resolution  sensor.  MJSs  can  be  used  to  model  the  packet  loss 
or  delay  issue  also.  Tools  developed  in  the  program  arc  extended  and  then  combined  with  the  new  concept 
of  finite  path-dependent  logarithmic  quantizer  and  controller  to  solve  the  almost  sure  uniform  exponential 
stabilization  problem  of  MJSs  subject  to  logarithmically  quantized  state  feedbacks.  Explicit  constructions 
of  quantizers  and  controllers  arc  provided  along  with  the  semi-convex  approach  to  find  the  coarsest  stabiliz¬ 
ing  quantization  density.  The  framework  we  developed  provides  a  systematic  approach  to  model  multiple 
channel  constraints  in  problems  of  control  over  communication  networks.  Most  past  literature  in  this  area 
focuses  either  entirely  on  the  finite  bandwidth  issues,  for  example  or  exclusively  on  the  unreliable  transmis¬ 
sion  problem,  for  example.  Concurrent  treatment  of  these  intrinsically  related  constraints  only  appeal's  in 
a  few  recent  works.  An  application  of  the  framework  developed  here  is  uniform  stabilization  problem  of 
a  discrete-time  LTI  system  with  logarithmically  quantized  state  feedbacks  over  a  lossy  channel,  where  the 
packet  gets  dropped  according  to  a  Markovian  process.  This  models  the  situation  where  measurements  of 
the  system  are  distorted  not  only  As  a  special  case,  one  can  show  that  if  the  underlying  Markovian  process 
is  Bernoulli,  then  the  system  is  not  stabilizable  in  the  almost  sure  uniform  sense;  but  it  is  second-order 
stabilizable.  For  the  same  system,  also  studied  cases  when  it  is  almost  surely  uniformly  stabilizable.  Main 
contributions  of  this  work  are  developing  a  general  framework  for  stabilizing  MJSs  with  quantized  feed¬ 
backs,  presenting  a  semi-convex  algorithm  to  approach  the  coarsest  stabilizing  quantization  density,  and 
providing  a  systematic  paradigm  to  simultaneously  treat  multiple  feedback  channel  constraints. 

4  Metric-Based  Receding  Horizon  Control 

In  this  research  automata-switched  systems  synthesis  was  considered  with  the  goal  of  guaranteeing  finite- 
horizon  performance  when  different  operating  conditions  required  different  path-dependent  performance 
objectives.  Details  of  this  work  are  reported  in  [13,16,20]. 

The  focus  of  the  work  is  a  certain  class  of  Pareto  optimal  controller  synthesis.  More  specifically,  a 
moving  finite  horizon  performance  measure  over  a  forward  window  of  length  T  is  considered,  where  the 
objective  is  to  design  a  controller  that  assures  internal  stability  of  the  closed-loop  system.  It  is  allowed  to 
have  a  finite  memory  of  the  most  recent  length-M  switching  path  of  modes  (where  M  is  computed  as  part  of 
the  solution,  similar  to  the  previous  section)  as  well  as  perfect  observation  of  the  present  mode.  The  control 
objective  is  to  minimize  the  worst-case  T-step  receding-horizon  cost  over  all  start  time  and  over  all  admis¬ 
sible  switching  sequences.  Novel  conditions  that  guarantee  Pareto-optimal  path-by-path  output  regulation 
are  obtained.  The  novel  features  of  the  work  are  that  (a)  by  focusing  on  path-by-path  Pareto-optimality, 
one  can  give  different  weights  to  different  switching  paths;  (b)  Closed-loop  unform  exponential  stability 
is  guaranteed  and  does  not  require  a  sufficiently  long  horizon  length  T  ;  and  (c)  Dynamic  output  feedback 
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controllers  are  allowed  to  use  a  (finite)  memory  of  past  modes.  In  the  research  exact,  convex  synthesis 
conditions  for  dynamic  output  feedback  controllers  arc  expressed  in  terms  of  a  sequence  of  semidefinite 
programs.  Provided  is  an  exact  solution  to  the  linear  receding-horizon  control  problem  in  discrete  time,  a 
problem  of  long-standing  interest.  Considered  arc  nominal  systems  with  state  space  models  that  vary  in 
time,  whose  controllers  have  access  to  the  precise  statespace  model  of  the  plant  for  a  fixed  number  of  steps 
into  the  future,  but  only  have  foreknowledge  of  the  set  of  model  values  beyond  this  horizon.  In  fact,  con¬ 
sidered  is  a  more  general  scenario  where  evolution  within  the  latter  set  may  be  governed  by  an  automaton. 
We  provide  a  necessary  and  sufficient  convex  condition  for  the  existence  of  a  linear  output  feedback  con¬ 
troller  that  can  uniformly  exponentially  stabilize  such  a  system,  and  do  the  same  for  a  related  disturbance 
attenuation  problem.  Each  condition  is  in  terms  of  a  nested  sequence  of  semidefinite  programs,  where  (a) 
feasibility  to  any  element  provides  an  explicit  controller;  and  (b)  infeasibility  implies  that  a  controller  does 
not  exist  for  a  given  exponential  decay  rate. 

5  Decentralized  Control  and  Finite  Wordlength  Channels 

Also  motivated  by  control  over  networks,  the  program  considered  a  decentralized-control  scenario  in  the 
setting  of  limited  bandwidth  sensing  channels.  Specifically,  considered  was  a  decentralized  stabilization 
configuration  involving  a  linear  time-invariant(LTI)  plant,  regulated  by  multiple  control  stations  that  receive 
sensing  information  through  rate-limited  channels,  and  where  the  stations  arc  not  capable  of  communicating 
with  each  other  directly.  The  main  result  of  this  paid  of  the  program  is  a  sufficient  condition  on  the  data  rate 
of  respective  channels  to  guarantee  system  stabilizability.  In  the  research  an  explicit  way  to  construct  the 
associated  stabilizing  encoders,  decoders,  and  controllers  is  also  provided.  In  paid  of  the  work  it  is  shown 
that  the  control  algorithm  is  structurally  well-posed  to  model  mismatch.  This  research  is  detailed  in  the 
publication  [10].  A  detailed  overview  of  the  work  is  given  below. 

When  building  a  geographically-distributed  feedback  control  system  that  utilizes  a  communication  net¬ 
work,  issues  of  bandwidth  limitation,  latency,  and  packet  loss  become  inevitable  challenges,  adding  to  the 
challenge  already  presented  by  structural  constraints  imposed  by  the  communication  graph.  It  is  particu¬ 
larly  important  that  these  information  exchange  issues  be  systematically  addressed  when  aggressive  network 
control  schemes  arc  to  be  deployed.  The  particular  situation  investigated  in  this  research  is  a  stabilization 
problem  involving  a  multi-station  control  system  operating  over  rate-limited  data  links.  The  goal  is  for  the 
sub-controllers  to  stabilize  the  plant  using  only  their  locally  available  information  and  local  control  variables. 
Namely,  in  the  formulation  studied  the  decentralized  controller  structure  poses  a  topological  constraint  on 
information  exchange;  meanwhile,  the  limited  bandwidth  of  the  communication  channels  over  which  system 
measurements  arc  transmitted  to  controllers  (without  latency  or  packet  loss)  give  rise  to  a  non- topological 
limitation.  The  goal  of  the  research  was  a  stabilizing  algorithm  simultaneously  accommodating  these  two 
different  constraint  types. 

In  this  work  the  system  setup  is  depicted  in  Figure  1.  A  generic  LTI  plant  G  with  no  special  structural 
assumption  is  controlled  by  v  decentralized  control  stations.  The  state  space  representation  of  the  system  is 
given  in  Section  5.1. 

Each  local  measurement  yi  is  quantized,  encoded,  and  then  sent  to  its  respective  control  station  over 
a  noiseless  digital  memoryless  channel  with  capacity  Ri  bits  per  step,  without  latency  or  packet  loss.  We 
derive  coupled  upper  bounds  on  the  data  rates  required  on  each  channel  to  guarantee  global  asymptotic 
stabilizability.  We  also  provide  an  explicit  way  to  construct  the  associated  stabilizing  encoder,  decoder, 
communication  code,  and  controller.  This  unique  feature  of  the  work  makes  the  developed  algorithm  easy 
to  implement.  Furthermore,  the  stabilizing  algorithm  is  robust  against  model  mismatch;  namely,  the  stabi- 
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Figure  1 :  Decentralized  system  over  communication  channels  with  v  control  stations 


lization  is  a  well-posed.  This  is  an  important  implementation  issue  since  some  model  mismatch  between 
plant  and  controllers  is  generally  unavoidable. 

5.1  Formulation 

The  infinity  norm  of  a  vector  x  €  Mn  is  defined  as  H^Hoo  :=  max ]<,;<„  | xr \ .  The  infinity  norm  of  a 
matrix  A  €  Mnxm  is  defined  as  H^Hoo  :=  maxi<j<n  ^2jL  1  \Aij\.  We  denote  B^(a,  b)  as  a  p; -dimensional 
hypercube,  which  is  centered  at  point  a  with  edge  length  2b. 

The  decentralized  control  system  with  v  control  stations  as  shown  in  Figure  1  has  the  following  state- 
space  representation 


x(t  +  l)  =  Ax(t)  +  y ||x(0)||oo  <  E0 

i= 1 

Vi(t)  =  Cix(t),  *  =  1,2,  ■■■  ,v  (18) 

where  state  i  e  K",  controls  ut  €  Mm\  measurements  y,  €  MPi;  and  A,  B, ,  C%  arc  compatible  real  matrices. 

We  assume  the  system  is  unstable  to  make  the  problem  non-trivial;  that  is,  1  <  A  :=  ||  A||oo. 

Define  s*  :=  inf{m  such  that  dim(n™0  ker  CAl)  =  n  —  dim(/C^-)},  which  is  the  generalized  observ¬ 
ability  index  of  ( C't .  ,4 ) ;  in  other  words,  the  least  number  of  steps  needed  to  observe  the  state  in  Kjy  from 
measurements  y,  . 

Define  Wt  :=  \Cf  ( CiA)T  ■  ■  ■  (CiASi~1)T1\T ,  where  i  =  1,  •  •  •  ,  v  and  define  W+  as  its  general¬ 
ized  inverse. 

We  use  xt ( ■ )  =  Pi.x(-)  to  denote  the  projection  of  the  state  vector  in  /C/1,  where  P,  is  the  projection 
matrix  on  Kj-  along  K.t.  Notice  that  P,  here  is  not  the  natural  projection  since  xt ( ■ )  and  x(-)  are  of  the  same 
size.  We  use  xy ( • )  and  xt ( ■ )  to  denote  Station  V s  estimate  of  the  state  x(-)  and  its  projection  xr ( • )  in  ICf- 
respectively. 

The  ith  local  encoder  at  time  t  is  a  map  £i(t)  :  WPi  x  s|0,t  x  Mmd  to  S taking  values 

t  —  l],rtj[0,  t  —  1])  i — t  the  new  codeword.  Notation  E*  is  the  zth  codeword  space  and 
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1  denotes  the  union  of  all  past  codeword  spaces  up  to  time  t.  Notation  rr,  0.  t  —  1]  is  used  to  denote 
past  codewords  and  ut  [0,  i  —  1]  is  used  to  denote  all  past  local  controls.  The  local  encoder  knows  the  local 
decoding  policy  Vj  but  not  the  local  control  policy  C,  . 

The  local  decoder  at  time  t  is  a  map  T>i (t)  :  s[0’^  xKmit  to  taking  values  (cq[0,  t],  rti[0,  t  —  1])  i->- 
yi(t),  an  estimate  of  the  respective  measurement  yt.  The  decoder  knows  the  local  encoding  policy  £t  but  not 
the  local  control  policy  Cr  . 

The  ith  local  controller  at  time  t  is  a  map  Ci(t)  :  ]RP;F+i)  to  Mmi,  taking  values  yi[0,t]  i->-  m(t),  the 
local  control,  which  depends  causally  on  the  local  decoder’s  outputs. 

The  encoder  and  the  decoder  arc  assumed  to  have  unlimited  memory,  therefore  they  can  store  and  use 
all  the  past  information.  A  digital  noiseless  memoryless  channel  connects  each  local  encoder  and  decoder 
pair. 

5.2  Stabilizing  algorithm 

In  order  to  keep  the  notation  clean  and  describe  the  algorithm  more  efficiently,  the  main  idea  behind  the 
result  is  presented  in  the  two-control-station  setting,  that  is,  system  (18)  with  v  =  2.  The  algorithm  extends 
directly  to  the  multi-station  case.  All  technical  details  can  be  found  in  [10]. 

The  control  algorithm  adopted  here  is  divided  into  three  phases:  observation,  communication,  and  con¬ 
trol.  First,  both  stations  listen  to  the  system  with  no  controls  applied  in  order  to  compute  their  own  estimates 
of  the  initial  state.  Then  these  stations  exchange  their  estimates  by  coding  them  into  control  signals.  Finally, 
both  controllers  use  their  own  noisy  estimates  of  the  initial  state  to  design  controls,  and  try  to  drive  the  state 
of  the  system  back  to  zero. 

The  logic  behind  this  algorithm  is  that  if  the  data  rate  on  each  channel  is  high  enough,  then  measurements 
yi  get  sufficiently  finely  quantized  so  that  each  station  will  have  quite  accurate  information  about  the  initial 
state.  Then  the  control  action  taken  will  at  least  bring  the  state  to  a  smaller  uncertainty  set  than  the  initial 
one  and  then  eventually  lead  it  to  zero. 

Without  loss  of  generality,  we  assume  si  >  S2- 

5.2.1  Observation 

For  the  observation  stage,  we  have  the  following  lemma. 

Lemma  1.  Within  at  most  Si  steps,  Station  i  can  estimate  Xj(0)  =  Pix( 0)  with  error  bounded  by 


where  pi  =  dim(r/j),  e,  =  ||  Wi  [|oo||Ci||ooASi  \  and  AT,  =  2Ri  represents  the  number  of  quantization 
levels  on  channel  i. 

Let  us  consider  the  error  in  estimating  xf  sj)  at  time  t  =  st  —  1.  This  result  will  be  used  in  later 
derivation.  Let  Xi(si)  be  the  s^-step  ahead  estimate,  then 

||Xi(Si)  -  Xi(Sj)||oo  <  ASi||xj(0)  -  Xj(0)||oo  <  (19) 
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5.2.2  Communication 


At  time  t  =  si,  each  station  has  an  estimate  xt(0)  of  the  initial  state.  This  information  needs  to  be  exchanged 
between  them  for  stabilizing  purposes.  From  Station  i  to  Station  j,  we  only  need  to  send  (/  —  P;)x',  (0), 
where  i,j  =  1,2  and  i  /  j.  The  remaining  paid  is  directly  available  to  Station  j.  Since  direct  communication 
between  stations  is  not  available,  one  station  has  to  encode  its  estimate  into  control  signals  and  the  counter 
party  has  to  decode  it  based  on  its  local  measurements.  This  is  effectively  to  explore  the  perfect  channel 
through  the  plant. 

Recall  that  Station  i’ s  control  action  can  be  observed  by  Station  j  only  if  1Z,  f  K,j.  Assume  this  is  true, 
then  there  exists  a  positive  integer  U  such  that 


ti-i 


a,- 


:=  rank  <  C 


e=o 


u-i-e 


BiBj{A 


Txti- \-l 


+  0 


(20) 


Let  /3i  be  the  smallest  positive  integer  such  that  at3t  >  n,  where  n  =  dim(.x). 
Define  the  following  encoding  matrix  from  Station  i  to  Station  j 


Eji  — 


CjMi(ti,U ) 

CjMi(Piti,ti ) 


0 


CjMi(ti,U ) 


(21) 


where  Mt(p.  q)  =  ^2^=0  BiBf  (Aq~1~e)T .  It  is  clear  that  rank{£jj}  >  n.  Thus,  there  exist 

matrices  Si  and  T,  ,  such  that  S^Ey^T]  =  All  these  matrices  can  be  pre-computed  and  stored  in  both  local 
control  stations. 

We  have  the  following  lemma  on  information  exchange  between  multiple  stations  when  there  are  no 
non-topological  constraints;  in  other  words,  all  channels  are  perfect  and  are  able  to  transmit  real  numbers 
precisely  and  instantaneously. 


Lemma  2.  Given  system  (18)  with  no  communication  constraints,  and  assume  IZi  %.  ICjfori,j  =  1,2,  ,v, 

then  any  vector  f  €  Mn  can  be  encoded  into  a  control  sequence  Ui{€),  0  <  t  <  3iti  —  1  by  Station  i  and 
decoded  exactly  by  Station  j  from  its  measurements  yj^ktf),  where  k  =  1,  2,  •  •  •  ,  3i- 

Now  let  us  consider  the  information  exchange  in  the  two  station  system  (v  =  2)  with  the  bandwidth 
constraint  described  in  the  previous  sections.  We  have, 

Lemma  3.  Given  1Z\  %  K. 2,  Station  2  can  reconstruct  the  initial  state  x(0)  at  time  t  =  s  1  +  fiyti  with  error 
bounded  by 

Vi  ,  £1  ^2 

v^n~2  pVn~i  P¥N 2 

where  and  62  are  given  in  Lemma  1,  and 

m  =  ll^llooll^lloo  (A2i|)  (1  +  *yw2)  +  (22) 

p^llSfUooA^HTilU^  +  l) 

During  time  si  +  3it\  <t<s  1  +  (/?i  +  l)fi  —  1,  Station  1  applies  the  following  controls  to  the  system 
to  offset  the  previously  accumulated  control  effects, 

ui(t)  =  -B^  {AT)Sl+^1+l)tl~1~t  z 


18 


Sl+filtl  —  1 

Z'-M+it^h)  Asl+^tl-1~eB1u1(£) 

£=si 


where  M+  (-,  •)  is  the  generalized  inverse  of  M*(-,  •)  defined  in  Equation  (21). 

Meanwhile,  set  u^t)  =  0.  Then  at  time  t  =  s\  +  (/?i  +  l)fi,  the  system  state  x(t)  is  driven  to 


s(si  +  (/?i  +  l)ti)  =  ASl+^l+1^x{  0) 


If  (h  —  l)si  <  si  +  {(3\  +  l)ti  <  hsi  —  1  for  some  h  G  No,  then  let  u\(t)  =  U2(t)  =  0  for  time 
si  +  (d\  +  l)t\  <  t  <  hsi  —  1  in  order  to  take  advantage  of  the  repetitive  estimation  described  below. 

Both  the  encoder  £\  and  the  decoder  V\  know  exactly  the  controls  applied  up  to  time  h-s\,  so  they  can 
run  a  simulating  observation  process  and  compute  a  tighter  state  estimate.  The  basic  idea  is  to  observe 
ili(si),  ■  ■  ■  ,  yi(2s\  —  1),  and  then  estimate  aq(si)  using  the  same  method  as  in  the  proof  of  Lemma  1.  By 
repeating  the  process,  we  have  the  following  error  bound  for  s  ]  -step  ahead  estimate  similar  to  that  computed 
in  Equation  (19), 


|xi(msi)  -  xi(msi)||00  < 


||IE+ 


||Cill%Am(2ai— 1}£o 


\mslemEo 


1  <  m  <  h 


Then  we  start  the  information  transmission  from  Station  2  to  Station  1  at  time  t  =  hs\.  We  have  the 
following  result. 


Lemma  4.  Given  IZ2  %  £t>  Station  1  can  reconstruct  the  initial  state  x(0)  at  time  t 
error  bounded  bv 

(^  +  ^=  +  ^=)e0 

v  PVNi  PYNi  p^N2  ) 

where  e\  and  €2  are  given  in  Lemma  1,  and 


hs\  +  /?2^2  with 


m  = 


II^Hoo  (A^2  )"  (1  +  )  +  l=^\\B2\\o0P2 


P2  =  \\Bj\\00At^1\\T2\\c 


Finally,  we  can  also  design  controls  U2(t),  for  hs\  +  ^2  <  t  <  hs\  +  (£2  +  1)^2  —  1  to  drive  the  state 
of  the  system  back  to  x(t3)  =  Ahs i+(^2+1)t2x(0)  at  time  1 3  =  hs±  +  (/?2  +  1)^2- 


5.3  Control 

At  time  t3,  both  stations  have  their  estimates  about  the  initial  state,  namely  x\  (0)  and  2:2(0).  They  can  then 
compute  their  own  estimates  of  the  state  x(ts)  and  design  the  following  controls  independently  to  bring  the 
state  back  to  zero, 

Ui{t)  =  -Bj  {AT)t3+n~1^tzi,  t3<t<t3  +  n-l 

where 

Zi  :=  6iM+(n,n)At3+nXi( 0) 
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with  Mf  (•,  •)  defined  as  the  generalized  inverse  of  Mj  ( ■ ,  •)  in  Equation  (21)  and  0*  =  ||  Afi||ooEi=ill  ^i||oo)_1- 
The  norm  of  x(t3  +  n)  can  be  easily  bounded  as  follows. 

For  simplicity,  let  us  omit  the  parameter  n  in  Mfn,  n),  then  we  have 

2 

x(t3  +  n )  =  At3+nx(0)  -  ^OiMiM+A^XiiO) 

2=1 

2 

=  s  ^(J  -  MiM+)At3+n(x( 0)  -  Xi(0)) 

2=1 

Since  Mj  is  positive  semi-definite,  from  singular  value  decomposition,  it  is  clear  that  || I  —  MjM+|| oo  < 

1,  therefore. 


ll*(t3  +  n)||oo  <  E  6i\\I  —  MjM^llooA*3-1"71  max||x(0)  —  Xj(0)||oo 
2=1 

<  \t3+n  max||x(0)  —  TAOjlloo 

*=1,2 

Now,  we  can  state  the  main  result  in  the  two  station  case. 

Theorem  4.  If  we  follow  the  above  control  algorithm,  then  the  two-station  decentralized  system  (18)  with 
bandwidth  limited  sensing  channels  can  be  asymptotically  stabilized  if  the  following  inequality  is  satisfied 
for  some  0  <  5  <  1, 


5A~^3+n) 


max  — f=  H - -=  H - j= 

ij= 1.2  I  VNi  VNi 

*7 ft  X 


The  stabilizing  channel  data  rate  R,  is  then  given  by  log2  iVj. 


5.4  Example 

In  this  section,  we  use  the  algorithm  developed  in  Section  5.2  to  stabilize  the  following  system  and  derive 
the  corresponding  bandwidth  requirements, 

.  fi  oi  m  /  x  roi  / , 

x{t  +  l)  =  0  2  x(t)+  0  ui(t)+  1  U2(t ) 

yi  (t)  =  [o  l]  x(t)  (24) 

2/2 (t)  =  [l  o ]x(t)  ||x(0)||oo  <  Eq 

This  is  a  simplest  non-trivial  example.  The  system  is  jointly  controllable  and  observable  and  it  is  strongly 
connected.  Therefore  it  is  stabilizable  under  the  decentralized  information  structure.  However,  since  the 
controllable  subspace  of  any  single  station  coincides  with  its  own  unobservable  subspace,  no  station  can 
stabilize  any  mode  by  itself.  Therefore,  collaboration  is  mandatory  for  stabilization. 

The  information  lower  bound  for  this  system  is  R  >  1  bit/step  for  stabilization  purposes  if  centralized 
control  is  allowed. 

Let  us  compute  the  upper  bound  on  bandwidth  requirement  under  the  decentralized  information  struc¬ 
ture  using  our  algorithms:  first  the  original  one,  then  the  enhanced  version  with  simultaneous  information 
exchange. 
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It  is  clear  that  si  =  S2  =  1  in  this  example.  Thus,  outputs  yj(0), i  =  1,2  are  sufficient  for  stations  to 
reconstruct  their  estimates  of  the  initial  state.  If  there  is  no  quantization,  then  m{ 0)  =  x(Q)j,  i,j  =  1,2  and 
i  /  j,  where  x(0)j  denotes  the  jtb  component  of  the  initial  state  x(0).  However,  the  output  y,  is  quantized 
with  an  Ni -level  quantizer  on  the  i-th  channel.  Then  from  Lemma  1,  Station  1  and  2  have  [0  X20]  and 

[xio  0]  respectively  as  their  estimate  of  the  initial  state,  where  |ayo  —  x(0),|  <  Eq/Ni  for  i  =  1,  2. 

Now  we  can  exchange  information  about  the  initial  state.  Instead  of  constructing  /3j,  tt,  and  EVj  as  in 
Section  5.2,  we  simply  choose  rti(0)  =  X20  andri2(0)  =  0  since  the  only  difference  would  just  be  a  constant 
coefficient.  Following  Lemma  3,  we  have, 

M0h  -  Z20I  <  T(2  +  T  +  ±.)Eo  +  i_Eo 

which  is  also  the  upper  bound  of  ||x(0)  —  T' 2 ( f ) )  1 1 oo  due  the  structure  of  /C2 - 

Now  Station  1  applies  a  control  (1)  =  — X20  to  drive  the  state  x(2)  to  A2x(0). 

During  the  same  time,  £\  and  V\  run  the  simulation  process  and  estimate  x(2)2  as  X22  with  error 
bounded  by  |x22  -  rc(2)2 1  <  773  ^o- 

Now,  let  ui(2)  =  0  and  112(2)  =  xio-  We  can  compute  the  error  between  Station  l’s  estimate  xio  and 
x(0)i,  which  is  bounded  by 

1*1°  _  x(0)l1  -  ^E°  +  ivi(1  +  N2^E°  +  ^3e°  +  W2e° 

This  is  also  the  upper  bound  of  ||x(0)  -Xi(0)||oo. 

Station  2  now  applies  a  control  z/,2  (3)  =  —  2xio  to  drive  the  state  back  to  x(4)  =  yl4x(0). 

Now,  both  stations  have  a  full  estimate  of  the  initial  state,  so  we  can  design  controls  as  follows: 


Ui  (4) 

'1  O' 

X\0 

ju2(4)_ 

0  25 

X20_ 

The  condition  of  ||x(5)||00  <  Eq  is  equivalent  to 


max 


_8_  1  _8_ 

Nf  +  N^1  +  N2’  +  Nf  +  N2  ’ 


111  1 

W2  2  +  +  N2’ +  n[ 


<  1 


The  feasible  rate  region  is  given  in  Figure  2(a). 

There  is  a  significant  increase  in  the  rate  requirements  compared  to  the  centralized  result.  The  upper 
bound  of  total  required  stabilizing  data  rate  is  R±  +  R2  ~  15.0736  bits/step. 

We  now  proceed  to  use  the  enhanced  algorithm.  The  first  step  of  observation  does  not  change.  However, 
we  can  design  control  rti(0)  =  X20  and  ^2(0)  =  xio- 

Both  stations  can  compute  their  estimates  xio  and  X20  from  their  measurements  and  local  controls.  The 
errors  are  bounded  by 

|xio-xio|  <  I2/1  (1)  —  yi(l)|  +  2|x(0)2  —  x2o| 

1^20  -^2o|  <  |y2(l)  -  £2(1)1  +  |z(0)l  -  Xiol 

This  time  the  control  action  will  be  completed  at  time  t  =  3.  The  inequality  to  satisfy  is 


max 


1Vi(3+  N2  +V  +  AV 


1  .  1  1,1 

—  (2  H - 1 - )  H - 

N2  N2  NiJ  Ni 


<  1 


The  improved  rate  region  is  plotted  in  Figure  2(b).  The  upper  bound  of  total  required  stabilizing  data 
rate  is  dropped  by  around  2  bits/step  to  13.0008  bits/step. 
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Rate  Region  Improved  Rate  Region 
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(a)  Rate  region  (b)  Improved  rate  region 

Figure  2:  Admissible  rate  regions  for  system  (24) 

6  Distributed  Control 

Another  thrust  area  for  the  project  was  distributed  control  over  graphs,  where  the  focus  was  on  designing 
distributed  controllers  for  interconnected  systems  in  situations  where  the  controller  sensing  and  actuation 
topology  is  inherited  from  that  of  the  plant.  The  main  contribution  of  this  research  was  to  provide  results  on 
general  graph  interconnection  structures  in  which  the  graphs  have  potentially  an  infinite  number  of  vertices. 
This  is  accomplished  by  first  extending  our  previous  machinery  which  was  developed  for  systems  with 
spatial  dynamics  on  integer  lattices.  From  this  we  derived  convex  analysis  and  synthesis  conditions  for 
design  in  this  setting.  Furthermore,  the  methodology  developed  here  provides  a  unifying  viewpoint  for  our 
previous  and  related  work  on  distributed  control.  The  research  is  reported  in  [17]. 

In  the  recent  work  of  [7,19]  we  have  further  built  on  these  research  tools  and  concepts.  Utilizing  a  novel 
operator-pencil  approach  to  represent  the  system  dynamics  we  obtain  stability  conditions  in  the  form  of  a 
generalized  lyapunov  inequality  coupled  with  an  inertia  condition.  A  Kalman- Yakubovic-Popov(KYP)-type 
lemma  is  also  presented  to  incorporate  performance  conditions  in  addition  to  stability.  These  results  provide 
less  conservative  convex  conditions  for  synthesis  of  control  policies  than  have  previously  been  available  in 
the  literature.  This  approach  can  also  adapt  this  work  to  be  applicable  for  infinite  graphs. 

7  General  Hybrid  Systems  Theory  and  Modeling 

The  focus  of  the  Pi’s  overall  research  program  is  automated  methods  for  control  analysis  and  synthesis.  The 
research  described  in  the  current  section  is  aimed  at  answering  fundamental  questions  about  model  types 
that  are  amenable  to  automated  analysis,  and  in  this  work  a  particular  new  model  class  is  introduced  and 
investigated.  The  work  is  reported  in  the  conference  manuscripts  [1,2,4,12]  and  the  journal  manuscripts 
[9,14,18]. 

With  the  wide  use  of  embedded  computing  and  control  algorithms  for  complex  systems  it  is  important  to 
have  models  for  the  interaction  of  computer  software  and  the  dynamic  environment  it  deals  with.  A  widely 
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known  model  for  such  systems  is  that  of  Hybrid  automata  (HA).  Hybrid  automata  have  both  discretely  and 
continuously  varying  states  both  whose  dynamics  may  be  tightly  coupled.  An  analysis  or  verification  prob¬ 
lem  asks  if  a  given  property  is  satisfied  by  a  given  model  of  a  system.  Due  to  the  complexity  allowed  by 
the  general  class  of  Hybrid  Automata  models,  even  simple  properties  such  as  the  reachability  problem  arc 
known  to  be  undecidable.  Previous  subclasses  of  Hybrid  Automata  that  do  admit  algorithms  for  temporal 
property  verification  require  either  very  simple  dynamics  for  their  continuous  components  or  strong  resets 
which  decouple  the  discrete  dynamics  from  the  continuous  dynamics.  These  observations,  with  some  ex¬ 
ceptions,  reinforced  the  folklore  impression  that  in  order  to  achieve  decidability  a  model  has  to  have  either 
restricted  coupling  between  continuous  and  discrete  dynamics  or  simple  continuous  dynamics 

In  this  research  component  we  have  shown  that  decidability  can  be  obtained  even  when  simultaneously 
allowing  complex  continuous  dynamics  and  strong  coupling  between  the  discrete-continuous  interactions. 
This  work  utilizes  the  notion  of  boundedness  in  both  discrete  and  continuous  dynamics.  Defining  a  class 
of  models  in  this  research  it  is  proved  that  systems  with  a  bounded-discrete-horizon  that  arc  definable  in  a 
so-called  o-minimal  structure  admit  a  finite  bisimulation.  When  the  theory  is  decidable  (e.g.,  semialgebraic 
FOL)  there  arc  algorithms  to  construct  such  a  bisimulation.  It  has  also  be  shown  how  an  extended  class  of 
models  suitable  for  embedded  and  realtime  systems  satisfies  these  specifications  and  hence  verification  of  a 
CTL  property  in  that  class  is  equivalent  to  verifying  a  property  on  a  finite  automaton  which  is  known  to  be 
decidable.  This  subclass  comprised  of  so-called  STORMED  hybrid  systems  (with  extensions)  which  satisfy 
the  following  constraints:  They  have  the  guards  of  two  discrete  transitions  separable  by  some  minimum 
positive  distance.  Next,  they  arc  definable  in  an  order-minimal  (o-minimal)  theory.  Furthermore,  the  flows 
(solutions  of  differential  equations)  of  the  continuous  states  have  positive  projections  on  some  monotonic 
direction  on  which  their  guards  have  delimited-ends.  It  has  been  demonstrated  that  the  constraints  of  this 
subclass  arc  reasonably  tight,  as  relaxations  of  any  of  the  them  yield  undecidable  models. 

In  addition  to  analysis  of  hybrid  models,  synthesis  of  control  policies  for  such  systems  has  also  been 
considered.  This  was  pursued  by  posing  synthesis  as  a  game,  and  the  notion  of  STORMED  hybrid  games 
(SHG)  was  introduced.  The  control  problem  for  SHG  systems  was  reduced  finding  a  bisimulation  on  finite 
game  graphs.  It  can  be  shown  that  this  generalizes  to  a  greater  family  of  games,  which  includes  o-minimal 
hybrid  games.  Also  solved,  in  the  sense  of  reducing  to  a  so-called  effective  algorithm,  is  the  optimal-cost 
reachability  problem  for  weighted  SHG. 
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